Pandas Profiling Report

Dataset statistics

Number of variables	17
Number of observations	6486
Missing cells	4302
Missing cells (%)	3.9%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	861.5 KiB
Average record size in memory	136.0 B

Variable types

NUM	11
CAT	6

Reproduction

Analysis started	2020-05-21 15:05:00.607212
Analysis finished	2020-05-21 15:05:19.469604
Duration	18.86 seconds
Version	pandas-profiling v2.8.0
Command line	`pandas_profiling --config_file config.yaml [YOUR_FILE.csv]`
Download configuration	config.yaml

Warnings

`name` has a high cardinality: 6102 distinct values	High cardinality
`host_name` has a high cardinality: 1200 distinct values	High cardinality
`last_review` has a high cardinality: 763 distinct values	High cardinality
`id` is highly correlated with `df_index`	High correlation
`df_index` is highly correlated with `id`	High correlation
`neighbourhood` is highly correlated with `neighbourhood_group`	High correlation
`neighbourhood_group` is highly correlated with `neighbourhood`	High correlation
`last_review` has 2151 (33.2%) missing values	Missing
`reviews_per_month` has 2151 (33.2%) missing values	Missing
`name` is uniformly distributed	Uniform
`df_index` has unique values	Unique
`id` has unique values	Unique
`number_of_reviews` has 2151 (33.2%) zeros	Zeros

df_index
Real number (ℝ_≥0)

HIGH CORRELATION
UNIQUE

Distinct count	6486
Unique (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	4202.673913043478
Minimum	0
Maximum	7906
Zeros	1
Zeros (%)	< 0.1%
Memory size	50.7 KiB

Quantile statistics

Minimum	0
5-th percentile	399.25
Q1	2310.25
median	4342.5
Q3	6157.75
95-th percentile	7578.75
Maximum	7906
Range	7906
Interquartile range (IQR)	3847.5

Descriptive statistics

Standard deviation	2267.190666
Coefficient of variation (CV)	0.5394638538
Kurtosis	-1.123690576
Mean	4202.673913
Median Absolute Deviation (MAD)	1910
Skewness	-0.155548045
Sum	27258543
Variance	5140153.514

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
4094	1	< 0.1%
5352	1	< 0.1%
3275	1	< 0.1%
5328	1	< 0.1%
7377	1	< 0.1%
1234	1	< 0.1%
3283	1	< 0.1%
5336	1	< 0.1%
1242	1	< 0.1%
5344	1	< 0.1%
Other values (6476)	6476	99.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%

Value	Count	Frequency (%)
7906	1	< 0.1%
7905	1	< 0.1%
7904	1	< 0.1%
7903	1	< 0.1%
7902	1	< 0.1%

id
Real number (ℝ_≥0)

HIGH CORRELATION
UNIQUE

Distinct count	6486
Unique (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	24477326.361856304
Minimum	49091
Maximum	38112762
Zeros	0
Zeros (%)	0.0%
Memory size	50.7 KiB

Quantile statistics

Minimum	49091
5-th percentile	5248223.75
Q1	17415009
median	26853730.5
Q3	32999241.25
95-th percentile	37260394.25
Maximum	38112762
Range	38063671
Interquartile range (IQR)	15584232.25

Descriptive statistics

Standard deviation	10014574.64
Coefficient of variation (CV)	0.4091367862
Kurtosis	-0.6657975761
Mean	24477326.36
Median Absolute Deviation (MAD)	7093476
Skewness	-0.6134689081
Sum	1.587599388e+11
Variance	1.002917053e+14

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
22890495	1	< 0.1%
18259421	1	< 0.1%
34696735	1	< 0.1%
12377633	1	< 0.1%
9738917	1	< 0.1%
37604899	1	< 0.1%
13643303	1	< 0.1%
12213801	1	< 0.1%
37684778	1	< 0.1%
30510635	1	< 0.1%
Other values (6476)	6476	99.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
49091	1	< 0.1%
50646	1	< 0.1%
56334	1	< 0.1%
71609	1	< 0.1%
71896	1	< 0.1%

Value	Count	Frequency (%)
38112762	1	< 0.1%
38110493	1	< 0.1%
38109336	1	< 0.1%
38108273	1	< 0.1%
38105126	1	< 0.1%

name
Categorical

HIGH CARDINALITY
UNIFORM

Distinct count	6102
Unique (%)	94.1%
Missing	0
Missing (%)	0.0%
Memory size	50.7 KiB

Luxury hostel with in-cabin locker - Single mixed	13
Inviting & Cozy 1BR APT 3 mins from Tg Pagar MRT	9
Studio Apartment - Oakwood Premier	9
Tasteful & Cozy 1 BR near SGH/Tiong Bahru	8
Superhost 1BR APT in the heart of Tg Pagar	8
Other values (6097)	6439

Common Values
Length

Value	Count	Frequency (%)
Luxury hostel with in-cabin locker - Single mixed	13	0.2%
Inviting & Cozy 1BR APT 3 mins from Tg Pagar MRT	9	0.1%
Studio Apartment - Oakwood Premier	9	0.1%
Tasteful & Cozy 1 BR near SGH/Tiong Bahru	8	0.1%
Superhost 1BR APT in the heart of Tg Pagar	8	0.1%
City-located 1BR loft apartment BRAND NEW	8	0.1%
Stylish 1BR Located 7 mins from Tg Pagar MRT	7	0.1%
Single Capsule For 1 (Free Breakfast)	7	0.1%
City-located studio loft apartment BRAND NEW	6	0.1%
Spacious bedroom near city centre with free Wi-Fi	6	0.1%
Other values (6092)	6405	98.8%

Length

Max length	92
Median length	41
Mean length	38.83811286
Min length	1

host_id
Real number (ℝ_≥0)

Distinct count	1680
Unique (%)	25.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	95489047.25254394
Minimum	23666
Maximum	288567551
Zeros	0
Zeros (%)	0.0%
Memory size	50.7 KiB

Quantile statistics

Minimum	23666
5-th percentile	3454695.75
Q1	23336011
median	66406177
Q3	159804766
95-th percentile	250849933.8
Maximum	288567551
Range	288543885
Interquartile range (IQR)	136468755

Descriptive statistics

Standard deviation	84151089.48
Coefficient of variation (CV)	0.8812643115
Kurtosis	-0.9558974453
Mean	95489047.25
Median Absolute Deviation (MAD)	56157733
Skewness	0.6410881293
Sum	6.193419605e+11
Variance	7.081405861e+15

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
66406177	215	3.3%
8492007	201	3.1%
209913841	157	2.4%
29420853	141	2.2%
31464513	113	1.7%
2413412	111	1.7%
219550151	109	1.7%
108773366	109	1.7%
8948251	83	1.3%
23722617	83	1.3%
Other values (1670)	5164	79.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
23666	1	< 0.1%
59498	3	< 0.1%
165209	2	< 0.1%
184596	1	< 0.1%
227796	1	< 0.1%

Value	Count	Frequency (%)
288567551	1	< 0.1%
288546201	1	< 0.1%
288249975	1	< 0.1%
288110467	1	< 0.1%
288016519	2	< 0.1%

host_name
Categorical

HIGH CARDINALITY

Distinct count	1200
Unique (%)	18.5%
Missing	0
Missing (%)	0.0%
Memory size	50.7 KiB

Alvin	246
Jay	227
Richards	157
Aaron	144
Darcy	113
Other values (1195)	5599

Common Values
Length

Value	Count	Frequency (%)
Alvin	246	3.8%
Jay	227	3.5%
Richards	157	2.4%
Aaron	144	2.2%
Darcy	113	1.7%
Kaurus	111	1.7%
Rain	109	1.7%
RedDoorz	109	1.7%
Alex	96	1.5%
Joey	92	1.4%
Other values (1190)	5082	78.4%

Length

Max length	35
Median length	5
Mean length	5.96083873
Min length	1

neighbourhood_group
Categorical

HIGH CORRELATION

Distinct count	5
Unique (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	50.7 KiB

Central Region	5327
East Region	374
West Region	373
North-East Region	248
North Region	164

Common Values
Length

Value	Count	Frequency (%)
Central Region	5327	82.1%
East Region	374	5.8%
West Region	373	5.8%
North-East Region	248	3.8%
North Region	164	2.5%

Length

Max length	17
Median length	14
Mean length	13.71862473
Min length	11

neighbourhood
Categorical

HIGH CORRELATION

Distinct count	41
Unique (%)	0.6%
Missing	0
Missing (%)	0.0%
Memory size	50.7 KiB

Kallang	903
Geylang	890
Novena	489
Rochor	432
Outram	419
Other values (36)	3353

Common Values
Length

Value	Count	Frequency (%)
Kallang	903	13.9%
Geylang	890	13.7%
Novena	489	7.5%
Rochor	432	6.7%
Outram	419	6.5%
Bukit Merah	379	5.8%
Downtown Core	359	5.5%
River Valley	311	4.8%
Bedok	283	4.4%
Queenstown	199	3.1%
Other values (31)	1822	28.1%

Length

Max length	23
Median length	7
Mean length	8.3484428
Min length	5

latitude
Real number (ℝ_≥0)

Distinct count	4162
Unique (%)	64.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1.3130704193647857
Minimum	1.24387
Maximum	1.45328
Zeros	0
Zeros (%)	0.0%
Memory size	50.7 KiB

Quantile statistics

Minimum	1.24387
5-th percentile	1.278865
Q1	1.29549
median	1.31067
Q3	1.3203
95-th percentile	1.375195
Maximum	1.45328
Range	0.20941
Interquartile range (IQR)	0.02481

Descriptive statistics

Standard deviation	0.02947909119
Coefficient of variation (CV)	0.02245050285
Kurtosis	4.825492501
Mean	1.313070419
Median Absolute Deviation (MAD)	0.012645
Skewness	1.848773173
Sum	8516.57474
Variance	0.0008690168176

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1.31125	8	0.1%
1.31141	8	0.1%
1.31137	7	0.1%
1.28376	7	0.1%
1.31269	6	0.1%
1.29488	6	0.1%
1.31523	6	0.1%
1.31441	6	0.1%
1.31146	6	0.1%
1.31534	6	0.1%
Other values (4152)	6420	99.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1.24387	1	< 0.1%
1.24526	1	< 0.1%
1.24847	1	< 0.1%
1.24853	1	< 0.1%
1.24881	1	< 0.1%

Value	Count	Frequency (%)
1.45328	1	< 0.1%
1.45203	1	< 0.1%
1.44968	1	< 0.1%
1.44928	1	< 0.1%
1.44893	1	< 0.1%

longitude
Real number (ℝ_≥0)

Distinct count	4565
Unique (%)	70.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	103.85008639685475
Minimum	103.66547
Maximum	103.97341999999999
Zeros	0
Zeros (%)	0.0%
Memory size	50.7 KiB

Quantile statistics

Minimum	103.66547
5-th percentile	103.7646175
Q1	103.8378425
median	103.85024
Q3	103.873045
95-th percentile	103.9115475
Maximum	103.97342
Range	0.30795
Interquartile range (IQR)	0.0352025

Descriptive statistics

Standard deviation	0.04122036085
Coefficient of variation (CV)	0.0003969217772
Kurtosis	2.415018947
Mean	103.8500864
Median Absolute Deviation (MAD)	0.014535
Skewness	-0.7976317333
Sum	673571.6604
Variance	0.001699118149

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
103.85366	6	0.1%
103.85192	6	0.1%
103.84296	6	0.1%
103.85361	6	0.1%
103.84523	6	0.1%
103.83863	6	0.1%
103.87672	6	0.1%
103.88788	5	0.1%
103.85161	5	0.1%
103.84691	5	0.1%
Other values (4555)	6429	99.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
103.66547	1	< 0.1%
103.68536	1	< 0.1%
103.68676	1	< 0.1%
103.68744	1	< 0.1%
103.68779	1	< 0.1%

Value	Count	Frequency (%)
103.97342	1	< 0.1%
103.97292	1	< 0.1%
103.97105	1	< 0.1%
103.96815	1	< 0.1%
103.96751	1	< 0.1%

room_type
Categorical

Distinct count	3
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	50.7 KiB

Entire home/apt	3546
Private room	2595
Shared room	345

Common Values
Length

Value	Count	Frequency (%)
Entire home/apt	3546	54.7%
Private room	2595	40.0%
Shared room	345	5.3%

Length

Max length	15
Median length	15
Mean length	13.58695652
Min length	11

price
Real number (ℝ_≥0)

Distinct count	334
Unique (%)	5.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	156.96793092815295
Minimum	14
Maximum	999
Zeros	0
Zeros (%)	0.0%
Memory size	50.7 KiB

Quantile statistics

Minimum	14
5-th percentile	35
Q1	69
median	131
Q3	200
95-th percentile	381
Maximum	999
Range	985
Interquartile range (IQR)	131

Descriptive statistics

Standard deviation	121.7328327
Coefficient of variation (CV)	0.7755267713
Kurtosis	6.951821767
Mean	156.9679309
Median Absolute Deviation (MAD)	66
Skewness	2.126890986
Sum	1018094
Variance	14818.88255

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
60	162	2.5%
100	146	2.3%
131	145	2.2%
200	140	2.2%
50	139	2.1%
150	133	2.1%
119	122	1.9%
69	121	1.9%
56	106	1.6%
90	106	1.6%
Other values (324)	5166	79.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
14	1	< 0.1%
15	1	< 0.1%
18	2	< 0.1%
19	24	0.4%
21	8	0.1%

Value	Count	Frequency (%)
999	3	< 0.1%
950	1	< 0.1%
900	3	< 0.1%
890	1	< 0.1%
887	1	< 0.1%

minimum_nights
Real number (ℝ_≥0)

Distinct count	69
Unique (%)	1.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	19.107924761023742
Minimum	1
Maximum	1000
Zeros	0
Zeros (%)	0.0%
Memory size	50.7 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	3
Q3	15
95-th percentile	90
Maximum	1000
Range	999
Interquartile range (IQR)	13

Descriptive statistics

Standard deviation	43.31019964
Coefficient of variation (CV)	2.266609283
Kurtosis	68.81668176
Mean	19.10792476
Median Absolute Deviation (MAD)	2
Skewness	5.904722085
Sum	123934
Variance	1875.773393

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1	1541	23.8%
2	1108	17.1%
3	962	14.8%
90	473	7.3%
30	374	5.8%
7	337	5.2%
5	318	4.9%
18	180	2.8%
6	175	2.7%
4	166	2.6%
Other values (59)	852	13.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	1541	23.8%
2	1108	17.1%
3	962	14.8%
4	166	2.6%
5	318	4.9%

Value	Count	Frequency (%)
1000	1	< 0.1%
700	1	< 0.1%
365	25	0.4%
360	2	< 0.1%
356	1	< 0.1%

number_of_reviews
Real number (ℝ_≥0)

ZEROS

Distinct count	203
Unique (%)	3.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	14.121800801726796
Minimum	0
Maximum	323
Zeros	2151
Zeros (%)	33.2%
Memory size	50.7 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	2
Q3	12
95-th percentile	70.75
Maximum	323
Range	323
Interquartile range (IQR)	12

Descriptive statistics

Standard deviation	30.79246766
Coefficient of variation (CV)	2.180491574
Kurtosis	21.56055384
Mean	14.1218008
Median Absolute Deviation (MAD)	2
Skewness	4.074715453
Sum	91594
Variance	948.1760644

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	2151	33.2%
1	862	13.3%
2	454	7.0%
3	289	4.5%
4	206	3.2%
5	171	2.6%
6	159	2.5%
7	127	2.0%
8	110	1.7%
9	102	1.6%
Other values (193)	1855	28.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	2151	33.2%
1	862	13.3%
2	454	7.0%
3	289	4.5%
4	206	3.2%

Value	Count	Frequency (%)
323	1	< 0.1%
307	1	< 0.1%
296	1	< 0.1%
291	1	< 0.1%
289	1	< 0.1%

last_review
Categorical

HIGH CARDINALITY
MISSING

Distinct count	763
Unique (%)	17.6%
Missing	2151
Missing (%)	33.2%
Memory size	50.7 KiB

2019-08-12	147
2019-08-11	122
2019-08-13	109
2019-08-10	84
2019-08-08	77
Other values (758)	3796

Common Values
Length

Value	Count	Frequency (%)
2019-08-12	147	2.3%
2019-08-11	122	1.9%
2019-08-13	109	1.7%
2019-08-10	84	1.3%
2019-08-08	77	1.2%
2019-08-04	71	1.1%
2019-08-25	63	1.0%
2019-08-05	62	1.0%
2019-08-24	59	0.9%
2019-07-29	59	0.9%
Other values (753)	3482	53.7%
(Missing)	2151	33.2%

Length

Max length	10
Median length	10
Mean length	7.67853839
Min length	3

reviews_per_month
Real number (ℝ_≥0)

MISSING

Distinct count	520
Unique (%)	12.0%
Missing	2151
Missing (%)	33.2%
Infinite	0
Infinite (%)	0.0%

Mean	1.1483737024221454
Minimum	0.01
Maximum	13.0
Zeros	0
Zeros (%)	0.0%
Memory size	50.7 KiB

Quantile statistics

Minimum	0.01
5-th percentile	0.07
Q1	0.23
median	0.66
Q3	1.55
95-th percentile	3.963
Maximum	13
Range	12.99
Interquartile range (IQR)	1.32

Descriptive statistics

Standard deviation	1.335390003
Coefficient of variation (CV)	1.162853172
Kurtosis	7.313129462
Mean	1.148373702
Median Absolute Deviation (MAD)	0.5
Skewness	2.212140844
Sum	4978.2
Variance	1.783266459

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1	162	2.5%
0.12	74	1.1%
0.08	68	1.0%
0.14	67	1.0%
0.16	62	1.0%
0.15	61	0.9%
0.1	59	0.9%
0.06	58	0.9%
0.07	55	0.8%
0.17	54	0.8%
Other values (510)	3615	55.7%
(Missing)	2151	33.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.01	2	< 0.1%
0.02	23	0.4%
0.03	45	0.7%
0.04	44	0.7%
0.05	43	0.7%

Value	Count	Frequency (%)
13	1	< 0.1%
12.6	1	< 0.1%
12	1	< 0.1%
11.03	1	< 0.1%
8.37	1	< 0.1%

calculated_host_listings_count
Real number (ℝ_≥0)

Distinct count	55
Unique (%)	0.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	46.2104532839963
Minimum	1
Maximum	274
Zeros	0
Zeros (%)	0.0%
Memory size	50.7 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	3
median	14
Q3	67
95-th percentile	203
Maximum	274
Range	273
Interquartile range (IQR)	64

Descriptive statistics

Standard deviation	65.78037772
Coefficient of variation (CV)	1.423495617
Kurtosis	3.222337907
Mean	46.21045328
Median Absolute Deviation (MAD)	13
Skewness	1.916977448
Sum	299721
Variance	4327.058093

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1	1010	15.6%
2	510	7.9%
3	285	4.4%
274	215	3.3%
203	201	3.1%
67	197	3.0%
4	185	2.9%
8	182	2.8%
7	165	2.5%
6	165	2.5%
Other values (45)	3371	52.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	1010	15.6%
2	510	7.9%
3	285	4.4%
4	185	2.9%
5	163	2.5%

Value	Count	Frequency (%)
274	215	3.3%
203	201	3.1%
157	157	2.4%
141	141	2.2%
114	113	1.7%

availability_365
Real number (ℝ_≥0)

Distinct count	358
Unique (%)	5.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	253.07107616404565
Minimum	1
Maximum	365
Zeros	0
Zeros (%)	0.0%
Memory size	50.7 KiB

Quantile statistics

Minimum	1
5-th percentile	38
Q1	148
median	315
Q3	359
95-th percentile	365
Maximum	365
Range	364
Interquartile range (IQR)	211

Descriptive statistics

Standard deviation	121.0503252
Coefficient of variation (CV)	0.4783254057
Kurtosis	-1.063038603
Mean	253.0710762
Median Absolute Deviation (MAD)	50
Skewness	-0.7120982325
Sum	1641419
Variance	14653.18122

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
365	835	12.9%
364	329	5.1%
362	149	2.3%
358	130	2.0%
359	117	1.8%
363	116	1.8%
361	84	1.3%
356	80	1.2%
360	80	1.2%
180	67	1.0%
Other values (348)	4499	69.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	15	0.2%
2	19	0.3%
3	16	0.2%
4	11	0.2%
5	9	0.1%

Value	Count	Frequency (%)
365	835	12.9%
364	329	5.1%
363	116	1.8%
362	149	2.3%
361	84	1.3%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

First rows

	df_index	id	name	host_id	host_name	neighbourhood_group	neighbourhood	latitude	longitude	room_type	price	minimum_nights	number_of_reviews	last_review	reviews_per_month	calculated_host_listings_count	availability_365
0	0	49091	COZICOMFORT LONG TERM STAY ROOM 2	266763	Francesca	North Region	Woodlands	1.44255	103.79580	Private room	83	180	1	2013-10-21	0.01	2	365
1	1	50646	Pleasant Room along Bukit Timah	227796	Sujatha	Central Region	Bukit Timah	1.33235	103.78521	Private room	81	90	18	2014-12-26	0.28	1	365
2	2	56334	COZICOMFORT	266763	Francesca	North Region	Woodlands	1.44246	103.79667	Private room	69	6	20	2015-10-01	0.20	2	365
3	3	71609	Ensuite Room (Room 1 & 2) near EXPO	367042	Belinda	East Region	Tampines	1.34541	103.95712	Private room	206	1	14	2019-08-11	0.15	9	353
4	4	71896	B&B Room 1 near Airport & EXPO	367042	Belinda	East Region	Tampines	1.34567	103.95963	Private room	94	1	22	2019-07-28	0.22	9	355
5	5	71903	Room 2-near Airport & EXPO	367042	Belinda	East Region	Tampines	1.34702	103.96103	Private room	104	1	39	2019-08-15	0.38	9	346
6	6	71907	3rd level Jumbo room 5 near EXPO	367042	Belinda	East Region	Tampines	1.34348	103.96337	Private room	208	1	25	2019-07-25	0.25	9	172
7	7	241503	Long stay at The Breezy East "Leopard"	1017645	Bianca	East Region	Bedok	1.32304	103.91363	Private room	50	90	174	2019-05-31	1.88	4	59
8	8	241508	Long stay at The Breezy East "Plumeria"	1017645	Bianca	East Region	Bedok	1.32458	103.91163	Private room	54	90	198	2019-04-28	2.08	4	133
9	9	241510	Long stay at The Breezy East "Red Palm"	1017645	Bianca	East Region	Bedok	1.32461	103.91191	Private room	42	90	236	2019-07-31	2.53	4	147

Last rows

	df_index	id	name	host_id	host_name	neighbourhood_group	neighbourhood	latitude	longitude	room_type	price	minimum_nights	last_review	reviews_per_month	calculated_host_listings_count	availability_365
6476	7897	38092051	New Small Room @Orchard/Somerset/Central Area	262337792	Herman	Central Region	River Valley	1.29482	103.83809	Private room	40	9	NaN	NaN	11	258
6477	7898	38092142	Well connected 2 bedroom 2 bathroom apartment !	223622603	Tanya	Central Region	Rochor	1.30082	103.84956	Entire home/apt	200	2	NaN	NaN	4	347
6478	7899	38094671	SMALL ROOM FOR ONE @SOMERSET/ORCHARD/CENTRAL AREA	262337792	Herman	Central Region	River Valley	1.29369	103.83768	Private room	33	7	NaN	NaN	11	359
6479	7900	38102097	环境优雅的公寓	286260560	Bo	West Region	Bukit Batok	1.35654	103.76028	Private room	90	3	NaN	NaN	1	83
6480	7901	38104971	2 PAX LOFT Close To Kent Ridge Park	278109833	Belle	Central Region	Queenstown	1.27973	103.78751	Entire home/apt	100	3	NaN	NaN	31	61
6481	7902	38105126	Loft 2 pax near Haw Par / Pasir Panjang. Free Wifi	278109833	Belle	Central Region	Queenstown	1.27973	103.78751	Entire home/apt	100	3	NaN	NaN	31	61
6482	7903	38108273	3bedroom luxury at Orchard	238891646	Neha	Central Region	Tanglin	1.29269	103.82623	Entire home/apt	550	6	NaN	NaN	34	365
6483	7904	38109336	[ Farrer Park ] New City Fringe CBD Mins to MRT	281448565	Mindy	Central Region	Kallang	1.31286	103.85996	Private room	58	30	NaN	NaN	3	173
6484	7905	38110493	Cheap Master Room in Central of Singapore	243835202	Huang	Central Region	River Valley	1.29543	103.83801	Private room	56	14	NaN	NaN	2	30
6485	7906	38112762	Amazing room with private bathroom walk to Orchard	28788520	Terence	Central Region	River Valley	1.29672	103.83325	Private room	65	90	NaN	NaN	7	365

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows